DOCUMENT RESUME 



ED 328 901 



CS 010 430 



AUTHOR 
TITLE 



INSTITUTION 

SPONS AGENCY 

PUB DATE 
CONTRACT 
NOTE 
PUB TYPE 



Stevens, Robert J.; And Others 

A Cooperative Learning Approach to Elementary Reading 
and Writing Instruction: Long-Term Effects. Report 
No. 42* 

Center for Research on Elementary and Kiddle Schools, 
Baltimore, MD. 

Office of Educational Research and Improvement (ED), 
Washington, DC» 
Nov 89 

G-83--00012; RI-G-90006 
43p. 

Reports Research/Technical (143) — 
Tests/Evaluation Instruments (160) 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



MF01/PC02 Plus Postaac^ 

^Cooperative Learning; Elementary Education; 

* Instructional Effectiveness; Longitudinal Studies; 

Metacorrnition; Reading Attitudes; ^Reading 

Instruction; Reading Research; Reading Strategies; 

Special Education; ^Writing Instruction; Writing 

Strategies 

Maryland 



ABSTRACT 

A year-long study determined the long-term effects of 
a comprehensive learning approach to elementary reading and writing 
instruction on students' achievement, attitudes, and metacognitive 
awareness. Subjects, 529 students in 29 second-- through sixth-grade 
classes in a suburlDan Maryland school district, participated in the 
Cooperative Integrated Reading and Composition (CIRC) program in 
which they worked in heterogeneous learning teams on a series of 
reading and writing activities related to basal stories. Teachers 
also provided students with direct instruction on comprehension and 
metacomprehension strategies* Results indicated: (1) signifir.ant 
effects in favor of CIRC on standardized achievement measures of 
reading vocabulary, reading comprehension, and language mechanics; 
and (2) greater metacognitive awareness for the CIRC students at the 
end of the year than for their traditionally instructed peers. In 
addition, special education students who were mainst reamed into CIRC 
classes had higher achievement on standardized tests, and were more 
socially accepted by their peers, than were comparable special 
education students in traditional settings. (Five tables of data are 
included; 40 references, an index of reading awareness, and an 
attitude questionnaire are attached.) (Author/RS) 
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The Outer 



The mission of the Center for Research on Hlementary and Middle Schools is tc 
produce useful knowledge about how elementary and middle schools can foster growth in 
studei.ts* learning and development, to develop and evaluate practical methods for 
improving the effectiveness of elementary and middle schools based on existing and new 
research findings, and to develop and evaluate specific strategies to help schools 
implement effective research-based school and classroom practices. 

The Center conducts its research in three program areas: (1) Elementary Schools; (2) 
Middle Schools, and (3) School Improvement, 

The Elementary School Program 

This program works from a strong existing research base to develop, evaluate, and 
disseminate effective elementary school and classroom practices; synthesizes current 
knowledge; and analyzes survey and descriptive data to expand the knowledge base in 
effective elementary education. 

The Middle School Program 

This program's research links current knowledge about early adolescence as a stage 
uf human development to school organization and classroom policies and practices for 
effective middle schools. The major task is to establish a research base to identify 
specific problem areas and promising practices in middle schools that will contribute to 
effective policy decisions and the development of effective school and classroom prac- 
tices. 

School Improvement Program 

This program focuses on improving the organizational perfoniiance of schools in 
adopting and adapting innovations and developing school capacity for change. 



This report, prepared by the l: Icnicntary School Program, examines the effects of a 
f ull-year implementation of ihc Cooperative Integrated Reading and Composition 
fn'ogram on students in second through sixth grades. 
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Abstract 



A year-long study was conducted to determine the long-term effects of a comprehensive 
learning approach to elementary reading and writing instruction on students' achievement, 
attitudes, and metacognitive awareness. In the Cooperative Integrated Reading and Composition 
(CIRC) program, students in second through sixth grade worked in heterogeneous learning teams 
on a series of reading and writing activities related to basal stories. Teachers also provided 
students with direct instruction on comprehension and metacomprchension strategics. 

The study found significant effects in favor of CIRC on standaniized achievement measures 
of reading vocabulary, reading comprehension, and language mechanics. The CIRC students 
also exhibited greater metacognitive awareness at the end of the yem than did their traditionally 
instructed peers. Finally, special education students who were mainstrcamed in CIRC classes 
had higher achievement on standardized tests, and were more socially accepted by their peers 
than were comparable special education students in traditional settings. 
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The Cooperative Integrated Reading and Composition (CIRC) program is a cooperative 
learning approach to teaching elementary reading and language arts. The CIRC program 
produced greater achievement gains on standardized tests than traditional instruction in two 
studies in grades three and four which lasted 12 and 24 weeks respectively (Stevens, Slavin, 
Madden, & Famish, 1987). This study extends the examination of the effectiveness of the CIRC 
program to a wider range of elementary grades and investigates the impact over an entire school 
year. 

Background 

The development of the CIRC program proceeded from an analysis of the problems in 
traditional classroom instruction in reading, writing and language arts. Basic and applied 
research was then integrated to build a classroom instruction model based upon state-of-the-art 
knowledge in classroom instruction, reading, writing and language arts. 

Classroom Instruction 

The classroom instruction revolves around the use of cooperative learning strategies derived 
from previous research at The Johns Hopkins University (Slavin, 1986). All activities in the 
CIRC program use the same instructional cycle. 

1 . Teacher instruction. The initial instruction always comes from the teacher, either in 
in.srructional groups (reading groups) or in whole class instruction. 
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2. Team practice. Students work in four- or five-member, mixed-ability learning teams to 
master the material presented by the teacher. Students work with the entire team, or with 
panners to complete practice activities and check each other, discuss answers and airive at 
consensus responses to questions, drill each other, and so on. Teammates also assess one 
another to make sure each individual will succe^ on the assessments. 

3. Individual assessment. Students are individually assessed on their learning of information 
or new skills that were presented. 

4. Team recognition. Students' scores on individual assessments are summed to form team 
scores. Teams which meet specific preestablished criteria receive certificates or rewards 
for their achievement. 

The cycle of instruction uses a direct instruction approach (Rosenshine & Stevens, 1986) 
with cooperative learning processes which use peers as instructional and motivational resources. 
The idea is to give students an incentive to do a good job helping their isaramates leam. Because 
the team succeeds on'y when all of the individuals on the team have learned the material, 
students take responsibility for one another's achievement as well as their own. In this way, 
students help each other and provide elaborated explanations of concepts or skills, which 
improves the comprehension of both students (Dansereau, 1985; Stevens, Slavin, & Farnish, in 
preparation; Webb, 1985). In applying cooperative learning principles to reading, writing, and 
language arts instruction, different forms of cooperative learning are used to meet the diverse 
objectives of reading comprehension, vocabulary, spelling, writing, and language mechanics; 
however, all instruction uses the cycle of instruction described above. 

Reading 

Follow-up activities. One major focus of the CIRC program reading activities is to make 
more effective use of follow-up time by having students work cooperatively on prescribed 
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ifnpn>vc studcnis' romprchension (e.g., Hrown <fe Palincsar. 1982; Day, 1980; Palincsar & 
Hrowii. 1984; Paris, Cross, Lipson, 19S4; Raphael, 1980; Stevens, 1988). 

Although many studies have demonstrated that explicit instruction can improve students' 
comprehension, few have attempted to assess the degree to which students' metacognitive 
awareness and control have changed as a result of instruction in strategic processes (Paris, 
Wasik, & Van der Westhuizen, in press). Metacognitive awareness and conti-ol of strategies is 
necessary if students are to integrate strategies into their repenoire and use them in appropriate 
situations, yet bs flexible enough to generalize their use to new situations (Baker & Brown, 
1984; Paris & Jacobs, 1984). For students to be independent, strategic readers they need to 
develop an awareness of their comprehension strategies, the ability to use strategies appropri- 
ately, and the knowledge of what to do when they encounter difficulty comprehending (Baker & 
Brown, 1984; Paris & Jacobs, 1984; Paris, et.al., 1984). 

Writing and Language Arts 

Another objective of the CIRC program is to integrate language ans and writing instruction, 
and to use a writing process approach. Typically, language arts instruction in elementary school 
allocates little time to writing activities, but students spend a good deal of time learning language 
mechanics skills in isolation (Bridge & Heibert, 1985; Graves, 1978). Recent research and 
program development has shown that a writing process approach-using a cycle of planning, 
drafting, revising, editing, and publishing compositi;.>ns--is a more effective approach to 
language arts instruction (Calkins, 1983; Graves, 1983; Raphael, Englert, & Kirschner, 1986). In 
this approach writing becomes the focus of instniction. Students are taught the essentials of 
style, coherence, and genre, and language mechanics instruction is integrated into their writing 
activiiics. 
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Elements of tiie CIRC Program 

The CIRC program consists of four main elements: grouping strategies, basal-related 
activities, direct instruction in comprehension strategies, and integrated writing and language 
arts. Instruction in each area follows the cycle of instruction presented previously. (See Stevens, 
et. al., 1987 for a more thorough description of the CIRC program.) 

* Grouping strategies 

Students are assigned to reading groups according to their reading instiiictional level, as 
determined by the teacher. In general, the teacher provides initial instruction in reading related 
activities separately for each group. 

Students are also assigned to pairs (or triads) within their reading groups, and then each pair 
is teamed with another pair from a different reading group. For example, a team might be 
composed of two students from the top reading group and two from the low group. Team 
members receive points based on their individual performances on all quizzes, compositions, and 
book reports, and these points are contributed to form a team score. Teams that meet a minimum 
average criterion of 90% on all activities in a given week are designated "superteams" and 
receive attractive certificates; those which meet an average criterion of 80-89% are designated 
"greatteams" and receive less elaborate certificates. As noted, research on t .e use of heteroge- 
neous teams that are rewarded on the basis of individual members' performance has established 
the instructional effectiveness of this approach (Slavin, 1983a, b). 

Basal' related Activities 

Students use their regular basal readers. Basal stories are introduced and discussed in 
teacher-led reading groups, which meet for about 20 minutes each day. During reading groups 
the teacher introduces new vocabulary, sets the purpose for reading, discusses the story after 
students have read it, and so on. 

5 
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After stories arc introduced, students are given a series of follow-up activities to do as teams 
or partners. The seatwork activities are directly related to the teacher-directed instruction of the 
reading group and to the basal stories. The goal is to make the activities more engaging and 
useful. The activities are as follows: 

a. Partner reading. Students read the story silently first, and then orally with their partners. 
During oral reading they take turns reading aloud, alternating readers after each paragraph. 
As one partner reads, the listener follows along and corrects any errors the reader makes. 
This repeated re;5ding of the story gives the students practice in decoding the words in 
context, which has been found to contribute to decoding ability (Dahl, 1979; Samuels, 
1979). Fanner reading also gives students a great deal of oral reading practice and enables 
the teacher to assess student performance by circulating and listening, withoui having to 
waste the time of other students in a reading group. 

b. Treasure Hunts. Students are given questions related to the story, called Treasure Hunts, 
which focus on comprehensioii of what happened in the story. The Treasure Hunts use 
questions which are related to the story structure to improve students' comprehension 
(Fitzgerald & Spiegel, 1983; Short & Ryan, 1982). For example, questions about narrative 
stories focus on the narrative structure: main characters, setting, problem, resolution. 
Students are also asked to predict how the problem might be solved and to clarify why 
characters behaved in a particular way, as prediction and clarification questions improve 
comprehension (Palincsar & Brown, 1984). 

c. Words out loud. Students are given a list of new or difficult words used in the story. They 
practice these words with their partner- until they are able to say them smoothly and 
accurately. The goal is to develop automaticity of the new words so they will not interfere 
with students' comprehension of the story (LaBergs & Samuels, 1974; Perfetti, 1985). 
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«1 Wani tm'iinitt^. Simk-ius are ^iven i\ list t»l' M«>ry words which arc new In ihcir speaking 
vocabularies and asked to Iwk them up in a dictionary, paraphrase the definition, and write 
a sentence for each that shows the meaning of the word (e.g., "An octopus grabbed the 
swimmer with its eight long legs," not "I have seen an octopus" ). 

e. Story retelling. After reading the siory and discussing it in their reading group, students 
summarize the main points of the story to their partners. They put the events in their own 
words, briefly restating them to their partners. Summarizing and paraphrasing content in 
one's own words has been found to improve the comprehension of what has been read 
(Doctorow, Wittrock, & Marks, 1978; Weinstein, 1982). 

f. Story-related writing. After reading the story, students are given a writing topic that 
requires them to respond in a few paragraphs to the story they have just read. They use a 
truncated form of the writing process used in the writing and language ans component to 
write their brief compositions. This activity allows students to elaborate on what they have 
read and relate it to their prior knowledge or previous experiences (Wittrock, 1981). 

Tests. At the end of the activity cycle for a story, students are given a comprehension test 
about the story, are asked to write meaningful sentences for vocabulary words, and are asked to 
read the word list aloud to the teacher. Students complete all of these tests independently. The 
test scores are ui;ed to determine team scores, as described previously. 

Direct Instruction in Comprehension Strategies 

One day each week, students receive direct instruction on specific reading comprehension 
skills such as identifying main ideas, drawing conclusions, and comparing and contrasting ideas. 
The instruction provides students with comprehension-fostering strategies and metacognitivc 
strategies like those developed in basic and applied research studies in reading comprehension 
(Brown & Palincsar, 1982; Palincsar & Brown, 1984; Paris, Cross, & Lipson, 1984; Raphael, 
1980; Stevens, 1988). 



The teacher first describes the strategy and when and why it is helpful for improving 
comprehension; then models the strategic process and shows students how to monitor the effec- 
tiveness of this use of the strategy. Students then prar»i=v ine use of the strategy on comprehen- 
sion wo -kshects or games with other team members. They first complete a poition of the activi- 
ties cooperatively, arriving at one consensus answer for the team. Then they work on other 
practice activities independently, with their teammates checking this work and providing correc- 
tive feedback. 

Integrated Writing and Language Arts 

During language arts time, teachers use a specific writing and language arts curriculum that 
focuses instruction on a writing process approach. Students are taught the components of the 
writing process-planning, drafting, revising, editing, and publishing-and how to use their peers 
and the teacher as resources for ideas and feedback to help them improve their composition. 
Teachers also provide direct instruction on specific writing activities related to how to improve 
coherence, how to write compositions ' f various types or genres, and how to increase readers' 
interest in their writing style. Language mechanics activities are integrated with the writing 
activities, with a focus on improving students' writing rather than as separate skills. 

Other Elements of CIRC 

In addition to the four main elements just described, the CIRC prog-am institutes indepen- 
dent reading at home and mainsrreaming of special education students. 

Independent reading. Students in CIRC have one standing homework assignment every 
night: inde^ .ndent reading for 20 minutes from a book of their choice. Typically, students 
select books from the school library for this activity. Every two weeks they complete either a 
written or oral book report on their independent reading, and points for the book report are used 
in their team score. 
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Maimtreaming apecial education students. One of the goals of the CIRC program is to 
provide an instructional process in which special education students can be effectively main- 
streamed for reading and language ans instruction. Resource room teachers discontinue their 
practice of pull-out remedial reading instruction for learning disabled students. Instead, the 
resource iwm teacher makes instructional groups out of all the identified students, regardless of 
grade, and takes each group of special education students at a common ability level into the 
regular education classroom, where team teaching occurs, with the regular education teacher 
teaching the rest of the class. 

The mainstreamed students are assigned to cooperative learning teams within tlie regular 
education class, so they interact on academic tasks with other students and gain the potential 
benefits of those interactions, as described previously. Also, cooperative learning processes 
provide a way for special education studenis to become socially mainstreamed as well through 
their interactions with their teammates in the classrooms. 

Research Plan 

The purpose of this study was to extend the previous research on the effectiveness of the 
CIRC program (see Stevens, et. a!., 1987). The two previous studies found that CIRC was 
effective in increasing students' achievement in reading and language arts in third and fourth 
grade. One ^oal of this research was to extend the CIRC program into second, fifth, and sixth 
grade. 

Second grade presented instaictional problems, particularly in integrating more decoding 
activities into the program and having younger students work cooperatively and provide one 
another with sub.stantive feedback during various cooperative activities. On the other hand, 
extending into fifth- and sixth-grade raised instructional issues relating to the degree to which 
various activities would sufficiently extend these students' comprehension. Also of concern was 
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ilitr (Ici^ruc !() wtiich older itudents •A^ould cooperate, and whether they would find the team scores 
and rewards meaningful. Previous research has shown cooperative learning processes to be 
effective with students through high school and college (Dansereau, 1985; Slavin, 1983b), but 
this was the first application of these processes at higher elementary grade levels in reading and 
language arts. 

Another goal of this study was to determine the effects of the CIRC program in a long-term 
implementation. The first two evaluations of CIRC lasted for 12 and 24 weeks respectively 
(Stevens, et. al., 1987). Although these studies support die program's effectiveness as a program- 
matic adoption rather than just an experimental treatment, a full-year implementation would 
provide more powerful evidence. Also, a full-year implementation of CIRC would reduce or 
eliminate the novelty of the program and thus any potential Hawthorne effect. 

A final goal of this study was to investigate the degree to which the strategic instruction in 
comprehension has an impact on students' metacogniiive awareness and control over those 
processes. It is thought that improved metacognition is important for long-term and flexible use 
of strategies (Baker & Brown, 1984; Paris & Jacobs, 1984). We will investigate this relationship 
by examining students' metacognition and their achievement gains in reading comprehension. 

Method 

Subjects and Design 

The subjects were 529 students in second-through sixth-grade in 29 classes in a suburban 
Maryland school district. Fifteen experimental classes in three schools were matched on Cali- 
fornia Achievement Test Total Reading pretest scores with 14 classes in three control schools. 
The student populations in these schools ranged from 0 to 10 percent minority students (r.iean of 
5.2%), and from 6 to 13 percent disadvantaged students (mean of 9%). Teachers volunteered to 
participate in the study, and teachers in the control group were offered the option of receiving 
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iniining ;it the conclusion u\' tlie study. The treatments were implemented during the entire 
1987-88 academic year. 

Treatments 

Control The control teachers continued using their traditional methods and curriculum 
materials. In reading, this usually consisted of using a basal series in two or three reading groups. 
Reading group time usually con-sisted of vocabulary instruction, story discussion, and a brief 
opportunity for oral reading turns. Typically students returned to their seats and completed the 
story by reading it silently and then they answered a few questions about the story. Students 
spent the majority of the seatwork time completing a variety of workbook and worksheet activi- 
ties and "skills." During language ans time teachers typically instructed the whole class on 
language mechanics activities. Approximately once or twice a week the teacher instructed the 
whole class on a writing topic and the students spent the remainder of the time in those periods 
on a writing task related to the instruction. 

Experimental. The experimental teachers were trained in the CIRC program as described 
above. The training consisted of two full-day training sessions, one for reading and one for 
writing and language ans. During the training, teachers were given explanations of how to do the 
classroom processes and what the rationale was behind them. Program elements were simulated 
for the teachers, with the trainer acting as the "teacher" and the teachers acting as "students." 
The teachers also received a detailed manual of the CIRC program. 

During the initial four weeks of the implementation, project staff observed tlie experimental 
teachers three or four times a week to monitor their implementation. The staff coached the 
teachers by providing them feedback on the implementation and answering their questions about 
the CIRC program. We particularly emphasized the implementation of the cooperative learning 
processes and the teacher-led direct insrmction. Periodically the project staff held after-school 
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meetings to provide further feedback and discussions of implementation questions with the 
teachers. As teachers became more proficient with CIRC, the observations occurred less 
frequently and at more random intervals. 

Measures 

Achievement pretests. Standardized achievement test scores were used to determine the 
equivalence of the treatment groups' initial ability. The California Achievement Test Total 
Reading and Total Language scores were obtained from the disuict's records. The district 
administered achievement tests during the fall of third and fifth grade; 'hus third- and fifth- 
graders' pretests were recent but fourth- and sixth-graders' pretest scores were a year old. Tlie 
district did not test second-graders, so the teachers administered the Califomia Achievement Test 
to second-graders in the fall as a pretest for this study. 

Achievement posttests. In May all teachers in the experimental and control treatments 
administered the California Achievement Test, using appropriate levels and a different form than 
that used in the pretest. Students completed the Reading Vocabulary, Reading Comprehension, 
Language Mechanics, and Language Expression subtests. 

Metacognition measure. Improved metacognitive ability often is a goal of instmctional 
interventions but is seldom directly measured as an outcome; rather, it is usually inferred through 
reading comprehension measures (Paris, Wasik and van der Westhuizen, in press). Jacobs and 
Paris (1987) have developed an informal assessment of metacognition called the Index of 
Reading Awareness, The index measures students' awareness of comprehension strategies, their 
knowledge of which stategies are appropriate for specific situations, and their knowledge of what 
to do if their comprehension is flawed. Previous research has shown that the Index of Reading 
Awareness is an effective measure of changes in metacognition resulting from instruction and is 
sensitive to developmental differences of metacognition (Jacobs k Pari.s, 1987). 
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A slightly modified version of the Index of Reading Awareness* was used as a pre- and 
positest measure of students' metacognition. The index is twenty multiple choice questions, each 
with three responses. The responses are scored as zero, one, or two, depending on the level of 
metacognitivc awareness indicated by that response (see questionnaire and response values in 
Appendix 1). The index is subdivided into four subscales which measure four major metacogni- 
tive activities: self-evaluation, planning, lelf- regulation, and conditional knowledge (Jacobs & 
Paris, 1987). This measure was not used with second-grade students because its readability was 
too difficult for those students. 

Attitude measures. Students were given brief attitude questionnaires as pre- and posttest 
measures of their attitudes toward their major subjects (see Appendix 2). The questions asked 
students 1) to list their three favorite subjects, and the three subjects they felt were their best 
subjects; and 2) to rate each subject in a multiple choice format ranging from "I like it a lot" to "I 
don't like it." 

The attitude measure was used in third-grade through sixth-grade but not in second-grade, 
again due to the readability level. 

Sociometric measure. The students were given a sociometric measure which asked them to 
list their best friends in the class. ITiis measure was used to determine the degree to which 
cooperative learning processes had an impact on tlie peer relations in thii classrooms. The 
sociometric measure was also used only in grades 3 through 6. 



♦Four of the original questions were changed to better reflect reading basal stories and the 
predominance of nairatives. 
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Results 



Implementation 

Following the first month of implementation, teachers were observec periodically 
throughout the duration of the study, at a minimum of once every two weeks, to maintain the 
fidelity of the program in the classrooms. Teacher variations in the presentation of instruction 
(e.g., new vocabulary, story discussion, writing activities) were accepted and encouraged, 
provided that the adaptations met the goals of the CIRC materials and processes outlined in the 
teacher's manual. We insisted, however, that the teachers used the cooperative learning pro- 
cesses described for each of the components. These standards were made clear during training, 
and subsequent observations indicated that although teachers did vary some of their instructional 
procedures, the prescribed cooperative interactions between students were evident in each of the 
components. 

Analyses 

The posttests were analyzed by adjusting for students' initial achievement, using either Total 
Reading or Total Language pretest scores, in random-effects, nested analyses of covariance 
(ANCOVA's). In these analyses, class was nested with treatment and the mean square of 
treatments were compared to that for classes, with the degrees of freedom associated to the 
number of classes, not the number of students. All analyses used standardized achievement test 
scores. 

Because the study encompassed a number of grade levels, analyses were conducted that 
entered grade and treatment as independent variables to determine if there was a significant 
grade by treatment interaction. Also, students were divided into three achievement levels (high, 
middle, low) based upon their initial achievement. Individual-level ANCOVA's were conducted 
with achievement level and treatment as independent variables to determine if there was a 
significant ability by treatment interaction. 
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Achievement pretests. As noted, experimental and control classes were matched initially on 
California Achievement Test Total Reading and Total Language scores. No significant pretest 
differences between the groups were found on either of these measures. 

Achievement posttests. The class-level ANCOVA's found highly significant differences 
favoring the experimental group on three of the four standardized tests: reading vocabulary {F(l , 
27) = 18.9, p<.01 ), reading comprehension {F(l, 27) = 14.4, p<.01 }, and language mechanics 
{F(l, 27) = 1 1.4, p<.01 }. There were no significant differences on the language expression test 
{F(l, 27) < 1.0). The standard score means and effect sizes are pre:»ented in Table 1. There 
were no significant grade by treatment interactions, so the data were collapsed across grade 
levels to investigate the treatment effects. For the collapsed means, the effect sizes (difference of 
the treatment means divided by the control standard deviation) of the significant results ranged 
from .25 to ,29 standard deviations. 



Table 1 About Here 



An inspection of the posttest means by grade level shows the treatment effects did vary at 
different grades (see Table 1) even though there were no significant grade by u-eatmem interac- 
tions. For the three outcome measures that yielded significant treatment effects, the effect sizes 
in second- through fifth-grade ranged from ,19 to .37 in reading vocabulary, from . 15 to .36 in 
reading comprehension, and from .30 to .62 in language mechanics. All these effects favored the 
experimental group. However, the sixth grade data show little or no difference between the 
treatment groups. 
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"I hc pusUcsi grade ctjuivalcni scores for the achievement tests are summarized in Table 2. 
In general, the grade equivalent means show that both treatment groups are at or above grade 
level for end-of-year testing. The experimental students consistently attained grade equivalent 
averages above that of control students. 



Table 2 About Here 



An investigation of the ability by treaimeni interaction was conducted by looking at the 
interaction between initial achievement level and treatment. There were no significant interac- 
tions between achievement level and treatment. 

Metacognition. There were no significant differences between the treatment groups on 
premeasures of die students' level of metacognitive knowledge as measured by the Index of 
Reading Awareness. The class-level analyses indicated significant posttest differences on the 
metacognition score in favor of the experimental group {F(l, 20) = 10.9, p<.01 }. There were no 
significant grade by treatment interactions on the metacognition measure, but the means pre- 
sented in Table 3 reflect a developmental trend, with older smdents scoring higher than younger 
students. 

The Index of Reading Awareness was evaluated to determine its test-retest reliability and 
internal consistency. The intercorrelation of the pretest and posttest was .73, and the internal 
consistency (coefficient alpha) was .69. Both measures of reliability are within acceptable levels 
for use in experimental research (Gronlund, 1977). 



Table 3 About Here 



16 

-> o 



Altitude measures. There were no significant pretest or postresi differences between the 
treatment groups on the attitude measures. Specifically, there were no significant differences in 
students' attitudes toward reading, writing, or mathematics. 

Sociometric measure. There were significant posttest differences between the treatments in 
the number of friends the students listed. A class-level analysis indicated a highly significant 
difference {F(l, 20) = 7.38, p = .01 ) in fiivor of the experimental group. Students in CIRC listed 
an average of 8.4 friends, whereas students in tradiuonal classes listed an average of 6.6 friends. 
There were no significant grade by treatment interactions on this outcome measure. 

Special Education Students 

The data for students who received special education or remedial reading services were 
analyzed separately to determine the impact of mainstreaming them through the use of coopera- 
tive learning processes. 

The data are summarized in Table 4, and grade equivalent scores are presented in Table 5. 
These students were primarily diagnosed as learning disabled students. The special education 
students in the control group typically received their instruction either in a self-contained class- 
room or through pull-out instruction from the resource teacher. 



Tables 4 & 5 About Here 



rietesis. There were no significant pretest {iiffercnces between the two treatment groups in 
this subsample. 
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Posttesfs. Individual level ANCOVAs of the achievement data for special education 
students indicated significant effects in favor of the experimental group on Reading Vocabulary 
{F(l. 35) = 13.4, p = .001 ), and Reading Comprehension {F(l. 35) = 4.36, p « .05}. There were 
no significant differences on any other standardized measures. The small number of special 
education students at each grade level limited the ability to do analyses by grade. 

There were no significant differences between the treatment groups on measures of special 
education students' attitudes or metacogniiive knowledge. 

Sociometric measure. The sociometric measure was used to determine the social integration 
of special education students. This was determined by comparing the frequency with which 
mainstreamed special education students were selected as friends by their regular education 
peers. Special education students in CIRC were selected more frequently on the average (4.9 
times per class) than were special education students in traditional classes (3.7 limes). These 
differences were not statistically significant, largely due to the small sample size. However, the 
effect size for the sociometric measure was .43. 

Discussion 

The results of this year-long study suppon the effectiveness of the CIRC program in 
producing significantly better reading and language achievement of students in second through 
sixth grade. The consistency and magnitude of the effects, along with the fact that they replicate 
previous results (Stevens, et. al., 1987), underscore the importance of the differences in favor of 
the CIRC program. 

In reading, the standardized achievement results indicate effects consistently in favor of 
CIRC, with effect sizes ranging from .05 to .37 in vocabulary and from .02 to .36 in comprehen- 
sion. Except for sixth grade, the results indicate that students in CII C generally achieve about a 
quaner of a standard deviation higher in reading than do their peers in traditional classes. These 
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icsults are very consistent with those found in two previous field experiments where the effect 
sizes favoring CIRC were . 1 1 and . 17 in vocabulary achievement and .35 and .19 in comprehen- 
sion achievcn«nl (Stevens, et.al. 1987). 

The inconsistent results in sixth grade are somewhat puzzling. The CIRC students' initial 
achievement was considerably lower than that of the traditional classes (see Table I). These 
initial differences, along with the small sixth-grade sample (one control class and one and a half 
experimental classes) suggest that additional research with a larger, more equivalent sample of 
sixth-grade students is needed to evaluate CIRC at that grade level. 

The results in language arts are less consistent across the three grade , tested. In language 
mechanics, CIRC students in third, fourth, and fifth grade clearly ouiperforiied those in tradi- 
tional classes, with effect sizes ranging from one-third to nearly two-thirds of a standard devia- 
tion. These results are very similar to previous studies which found effects on language 
mechanics favoring CIRC students by approximately one-third of a standard deviation (Stevens, 
et. al., 1987). However, the results on language expression were less consistent and smaller. 
CIRC students in third and fourth grade achieved nearly a quarter standard deviation higher than 
their peers, but students in fifth grade performed slightly lower. 

The results indicate that the reading activities in CIRC do more than simply improve 
students' ability to answer questions about isolated comprehension skills, as measured by 
achievement tests. The CIRC activities also improve students' ability to use and monitor 
comprehension strategies, which not only improves their ability to answer discrete questions 
about what they've read, but also improves their executive comprehension processes. The 
significant effects found on the Index of Reading Awareness indicate that CIRC students 
developed greater metacognitive knowledge and control than students in more traditional reading 
instruction. As measured by this Index, .students in CIRC exhibited more awareness of their 
cognitive activity in the areas of selfevaluation, planning, self-regulation, and conditional 
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knowledge. These processes have utility across a wide-range of reading contexts, and develop 
independence and self-control on the part of the reader (Baker & Brown, 1984; Paris, et. al., 
1984). 

The sociometnc measures indicate that students develop better peer relations using the 
cooperative learning processes of the CIRC program. In CIRC, students have structured 
opportunities to work together to attain a common goal. Over a year's dme, students change 
partners and learning teams often enough to eventually work with most or all of their classmates 
on cooperative learning activities. While completing the learning tasks, students learn about 
each other, which helps them develop better peer relations. These results are very consistent 
with a large body of research that shows that cooperative contact between students has a positive 
impact on peer relations and school friendships (Johnson & Johnson, 1981; Slavin, 1983a; Slavin 
& Hansen, 1983). The positive peer relations resulting from the CIRC program are indicated by 
the significantly greater number of friends listed by students in CIRC than by those in traditional 
instruction. 

This study also shows that CIRC is an extremely effective way to mainsu-eam special 
educadon students into the regular classroom. Special education students in CIRC performed 
significantly better than their nonmainstreamed peers. The CIRC program provides a structure 
that accommodates the increased academic diversity of the classroom brought on by main- 
streaming. Remedial reading and resource room teachers were able to teach subgroups of 
students within the regular clas:; on materials that were well integrated with what regular educa- 
tion students were doing. 1 he teachers also were able to develop sufficiently high expectations 
for the mainstreamed students, Ixith academically and I'chaviorally, helping them become better 
integrated into the regular classroom envimnment. 

Yet tmc mainstreaming goes beyond academics. Mainstreamed students need a classroom 
environment that will also promote their social ucvelopment and acceptance. The sociometnc 
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results of this study indicate CIRC accomplished this by producing better peer relations between 
special education and regular education students. In CIRC classes, regular education students 
more frequently selected a mainstreamed student as a friend. By working with special educntiiMi 
students in a mainstreamed cooperative learning structure, regular education students more 
readily accepted special education students into the social and academic milleau of the class- 
room. 

The results reported here demonstrate the effectiveness of a multi-faceted cooperative 
lear- 'ng approach to teaching reading and language arts. In particular, the results indicate thai an 
effective program can increase student achievement in reading and language arts, and at the same 
time increase students' knowledge and awareness of their own comprehension processes. Tlie 
results also indicate that mainstreaming mildly-handicapped students through CIRC can be 
effective in increasing their achievement and their social acceptance by regular education 
students. 
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Table I 



Standardized AchievemQnt Moasuras 
MBans, Standard Deviations and S£fBct Sizes 



CIRC 



Control 



Collapsad Across Grades 



Pretests 



Posttests 



Grade 2 

Pretests 

Posttests 

N 

Grade 3 
Pretests 

Posttests 



N 



Grade 4 



Pretests 



Posttests 



N 



69 



66 



Total Reading 


.00 


( 


.99) 


- 


.02 


{1 


.00) 




Total language 


. 02 


( 


. 98) 




.01 


(1 


.01) 




Reading Vocabulary 


.13 


( 


.92) 




.19 


(1 


.07) 


.29 


Reading Cos^rehension 


.10 


( 


.96) 




.16 


(1 


.04) 


.25 


Language Mechanics 


.13 


( 


.95) 




.17 


(1 


.07) 


.28 


Language Expression 


.04 


( 


. 98) 




.07 


<1 


.02) 


. 11 




2 


66 






263 






To^ax Reacixng 


. 00 


( 


.95) 




.00 


(1 


.07) 




Reading Vocabualry 


.14 


( 


.81) 




1 R 


(1 


.18) 


.27 


Reading Coxnprehension 


.16 


{ 


.92) 




20 


(1 


.07) 


.34 






77 








58 






Total Reading 


.01 


(.99) 




-.01 




L.04) 




Total Language 


-.05 




L.03) 




.05 


(.99) 




^\eacijLng vocaDUxary 




(. 


.96) 




.13 


(1. 


07) 


. 19 


KeacLLng u.osjprenen8Xon 


n 0 
. wo 


(. 


.86) 




.12 


(1. 


21) 


,16 


ifsnguage necnanxcs 


. ^ y 


(. 


89) 




.35 


(1. 


04) 


. 62 


Language Expression 


.12 


(. 


,95) 




.14 


(1. 


06) 


.24 






33 








20 






Total Reading 


.08 


(. 


93) 




,08 


(1. 


07) 




Total Language 


.10 


(. 


90) 




,16 


(1. 


13) 




Reading Vocabulary 


.18 


(. 


93) 




,20 


(1. 


04) 


.37 


Reading Cosiprehension 


.18 


{ . 


94) 




,19 


(1. 


03) 


.36 


Language Mechanics 


14 


(. 


91) 




,22 


(1. 


11) 


.32 


Language Expression 


.08 


(. 


98) 




13 


(1. 


03) 


.20 
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Table 1 (continued) 



Standardized Acbxev^ment Maasuras 
Means, Standard Deviations and Effect Sizes 



Grade 5 
Pretests 

Poattests 



Grade 6 
Pretests 

Posttests 



Total Reading 


-.01 


{ 


.91) 


.01 


(1 


.06) 




Total Z^anguage 


.03 


(1 


.04) 


-.03 


( 


.97) 




Raading Vocabulary- 


.15 


( 


. 91) 


-.10 


(1 


.05) 


.24 


Reading Cos^rehension 


.08 


(1 


.02) 


-.05 


( 


.98) 


.13 


Language Mechanics 


.16 


{ 


.93) 


-.15 


(1 


.04) 


.30 


Ztanguage Eapression 


- .06 


( 


. 99) 


.05 


(1. 


.02) 


-.11 






64 






93 






Total Raading 


-.10 


(1. 


,07) 


.09 


(. 


95) 




Total Language 


-.04 


(. 


,99) 


.05 


(1. 


02) 




Reading Vocabulary 


.03 


( . 


,97) 


-.02 


(1. 


05) 


.05 


Raading Con^srehension 


.01 


(1. 


,04) 


-.01 


<• 


,98) 


.02 


Language Mechanics 


.02 


(. 


,98) 


-.01 


(1. 


00) 


.03 


Language Expression 


-.01 


(. 


,97) 


.00 


(1. 


.02) 


-.01 



N 



23 



26 



26 
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7«bla 2 



Grada 2 
N 

Grade 3 



Grada 4 



N 

Grade 5 



Grade 6 



AchiBvamont Posttest 
Grade Equivalent Moans 



poattest 



Reading Vocabulary 
Reading Coiqprehension 



Reading Vocabulary 
Reading Con^rebanaion 
language Mechanics 
Language Saqpreasion 



Reading Vocabulary 
Reading Cooqprebension 
Language Mechanics 
Z.anguage Expression 



Reading vocabulary 
Reading Coo^rebension 
Language Mechanics 
Language Expression 



Reading Vocabulary 
Reading Coa^rebension 
Language Mechanics 
Language Es^ression 



CIRC 



3.28 
3.28 

77 



3.63 
3.44 
4.47 
3.61 

33 



5.21 
5.28 
5.27 
4.69 

69 



6.24 
6.59 
7.38 
5.92 

64 



7.13 
7.10 
7.04 
6.64 

23 



Control 



3.05 
2.86 



58 



3.43 
3.26 
3.49 
2.91 

20 



,59 
,01 
,74 
,59 

66 



5.68 
6.23 
6.09 
5.75 

93 



6.80 
7.00 
6.94 
6.70 

26 
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P 



7abltt 3 



Index of RQaddMg Awarmiess: 
Posttast 2ieans* 



Grade CIRC Control 

Collapsad 29.33 (4.78) 28.77 (4.60) 

3 27.24 (5.28) 26.58 (4. 61) 

4 29.22 (4.45) 28.38 (4.36) 

5 30.10 (5.04) 29.21 (4. 65) 

6 30.64 (3.80) 29.97 (4.73) 



* The questioxmaire consists o£ 20 questions each with three alternative 
choices. Choices are scored from 0 to 2, with 2 being the high score. Tota 
scores possible range from 0 to 40 . 
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Table 4 

StandardlzQd Achievmaant : Means and Standard Deviations 

Special Education Students 



Collapsed Across Grades 



Pretests 



Fosttests 



Total Reading 
Total Language 

Reading Vocabulary 
Reading Cooprehension 
Language Mechanics 
Language Expression 



CIRC 



•1.46 
•1.51 



(.54) 
(.79) 



K 



■1.04 (.62) 

-1.08 (.56) 

■1.11 (.73) 

-1.31 (1.21) 

16 



Control 



-1.18 (.90) 

-1.30 (1.09) 

•1.33 (1.07) 

•1.26 (1.01) 

-1.28 (.69) 

•1.45 (1.01) 

22 



Grade 2 

Pretests 

Posttests 

N 

Grade 3 
Pretests 

Posttests 



N 

Grade 4 
Pretests 

Posttests 



Total Kaading 


-1 , 


. 60 


( .04) 


-1 , 10 


(.10 


Reading Vocabulary 


mm 


.97 


(.39) 


-1.85 


(.11 


Reading Cozoprehanaion 


-1, 


.11 


(.30) 


-2.18 


(.34 








3 




2 


Total Reading 


-1 


.02 


(.57) 


-1.06 


(.61) 


Total language 


-1 


.42 


(.64) 


-1.09 


(.29) 


Reading Vocabulary 




.84 


(.38) 


-1.23 


( .21) 


Reading Con^rehension 




.64 


(.49) 


-1,58 


( .13) 


Language Mechanics 




.81 


(.41) 


-1.04 


(.23) 


Language Expreasion 


-1 


.02 


(.57) 


-1.42 


(.17) 








3 




2 


Total Reading 


-1, 


.59 


(.54) 


-1.42 


(.81) 


Total Language 


-1 


.56 


(.77) 


-1.55 


(.67) 


Reading Vocabulary 




.93 


(.61) 


-1.58 


(.57) 


Reading Con^rehenaion 


-1 


.26 


(.71) 


-1.21 


(.30) 


Language Mechanics 


-1, 


.24 


(.41) 


-1.34 


(.10) 


Language Expression 


-1 


.67 


(.65) 


-2.20 


(.40) 








3 




5 
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Table 4 (continuad} 

Standardizmd Achi&v&mant : Means and Standard Dexriations 

Special Education Stvd&nts 



Grade 5 



PretQsta 



Posttesta 



Total Reading 
Total Z^anguage 

Reading Vocabulary 
Reading Coaqprebenaion 
Language Mechanics 
Zianguage Sxpreaalon 



1,25 (.28) 

'1.54 (1.03) 

-.70 (.43) 

-.80 (.43) 

-1.13 (.71) 

-1,02 (.92) 



-1.33 
'1.54 



(.94) 
(.62) 



a, 31 (1.03) 

-1.23 (,86) 

-1.53 (.58) 

-1.19 (.78) 



K 

Grade 6 
Pretests 

Posttests 



10 



Total Reading 
Total Language 

Reading Vocabulary 
Reading Cos^rehenslon 
Language Mechanica 
Language Escpxreasion 



-1 


.94 


( 


.33) 


-.48 


(1.12) 


-1 


.78 


( 


.51) 


-.82 


(.88) 


-1 


.25 


( 


.20) 


-.72 


(1.56) 


-1 


.23 


( 


.58) 


-.65 


(1.62) 


-1 


.35 


{ 


.66) 


-.84 


(1.22) 




.54 


( 


.83) 


-1.20 


(1.06) 






3 






3 
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Table 5 



AchiQvomant Posttast: Special Education Stud&nts 

GradQ Equivalent Moans 



Poattast 



CZBC 



Control 



Grada 2 



Raading Vocabulary 2.65 
Raading ConprahexMion 2.56 



2.30 
2.22 



Grada 3 



N 

Grada 4 



Grade 5 



N 

Grada 6 



Reading Vocabulary 2.83 

Raading CooprahaxM ion 2.89 

Language Macbanlcs 3.00 

Language Esspresaion 2 . 52 



Raading Vocabulary 3.13 

Raading Coaprahansion 3.32 

Language Macbanics 3.15 

Language Sacpression 2.36 



Reading Vocabulary 4.78 

Reading Cooiprehansion 5 . 57 

Language Mechanics 4.20 

Language Saqpreasion 3.00 



heading Vocabulary 4.32 

R*^ading Coaqprehanaion 5.72 

Language Kechanica 5.66 

Language S3q>reaaion 5.22 



2.75 
2.36 
3.55 
2.34 



2.98 
3.53 
3.08 
1.91 



3.70 
5.20 
3.58 
2.80 

10 



5.39 
6.22 
6.04 
5.43 
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Appendix A 
Index of Reading Awareness 



DIRECTIONS: Read each of the questions and the answers that follow them. 

CIRCLE the letter of YOUR ANSWER to each question. 



1. What is the hardest part about reading for you? 

a. Sounding out the hard words. 

b. When you don't understand the story. 

c. Nothing is hard about reading for you. 



2. What would help you become a better reader? 

a. If move people would help you when you read. 

b. Reading easier books with shoner words. 

c. Checking to make sure you understand what you read. 



3. What is special about the first paragraph in a story? 

a. They always begin with "Once upon a time..." 

b. The first sentences are the most interesting. 

c. They often tell what the story is about. 



4. What is important about the main character in the story? 

a. The main character is the one who solves the problem of the 

story. 

b. The main character is the person or animal the story is mostly 

about. 

c. The main character is the hero of the story. 



5. How can you tell which sentences are the most important ones in a 
story? 

a. They're the ones that tell the most about the characters and 

what hapjjens. 

b. They're the most interesting ones. 

c. All of them are important. 



6. If you could only read some of the sentences in the story because 
you were in a hurry, which ones would you read? 

a. Read the sentences in the middle of the story. 

b. Read the sentences that tell you the most about the story. 

c. Read the interesting, exciting sentences. 
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7. When you tell oiher people about what you read, what do you tell 
them? 

a. What happened in the story, 

b. The number of pages in the book. 

c. Who the characters arc. 



8. If the teacher told you to read a story to remember the general 
meaning, what would you do? 

a. Skim through the story to find the main parts. 

b. Read all of the story and try to remember everything. 

c. Read the story and remember all of the wonis. 

9. Before you start to read, what kind of plans do you make to help 
you read better? 

a. You don't make any planr. You just start reading, 

b. You try to remember the meaning of the new vocabulary words. 

c. You think about what the story is going to be about. 

10. How does knowing the new vocabulary words help you when you read 

the story? 

a. Knowing the new vocabulary words helps you understand the 

parts of the story that use new words. 

b. Knowing the new words helps you predict what will happen in 

the story. 

c. Knowing the new vocabulary words helps you predict what will 

happen in the story, and they help you understand the story. 



1 1 . What would you do if you couldn't answer a question about the story? 

a. Ask your partner what the answer is. 

b. Talk to your partner and skim the story to find the answer. 

c. Skip that question and then discuss it in reading group. 



12. Why svoulU you go back and read things over again? 

a. Because it is good practice. 

b. Because you didn't understand it. 

c. Because you forgot some words. 



13. What do you do if you come to a word and you don't know what it 
means? 

a. Use the words around it to figure it out. 

b. Ask someone else. 

c. Go on to the next word. 



14. What do you do if you don't know what a whole sentence means? 

a. Read it again. 

b. Sound out all of the wonis. 

c. Think about the other sentences in the paragraph. 



15. If you were reading silently and didn't understand a paragraph, 
what would ycu do? 

a. Read the next paragraph to help you understand the last one. 

b. Reread the paragraph before going on to the next paragraph. 

c. Read to the end of the story before rereacUng parts of the story. 



16. If you are reading a story for fun, what would you do? 

a. Look at the pictures to get the meaning. 

b. Read the story as fast as you can. 

c. Imagine the story like a movie in your mind. 



17. If you are reading a factual story, what would you do to 
remember the information? 

a. Ask yourself questions about the important ideas. 

b. Skip the parts you don't understand. 

c. Reread the whole story. 



18. If you are reading for a test, which would help the most? 

a. Read the story as many times as possible. 

b. Talk about it with somebody to make sure you understand it. 

c. Say the sentences over and over. 
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19. If you are reading a library book to write a book repon, 
which would help you the most? 

a. Sound out words you don't know. 

b. Write it down in your own words. 

c. Skip the parts you don't understand 



20. Wliich of these is the best way to remember a story? 

a. Say every word over and over. 

b. Think about remembering it 

c. Write it down in your own words. 
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Appendix B 
Attitudo Questionnaire 



Here is a list o£ soaia o£ the subjects you stiidy in school. 
Reading Social Studies Kath Science Hriting/Lang -age Arts 

1. Write down the naxoas of the three subjects you LZRS TBS M0S7 on the 
lines below. Write the naata of your 7AV0RZTS one FIRST. 

1 2 

3 

2. Write dowii the names of the three subjects that YOU ARE BEST AT on the 
lines below. Write the name of your VERY BEST subject FIRST. 

1 2 

3 



3. Circle the words that show BOW MUCK YOU LIKE each of these subjects. 



Math: 


1 


like 


it- 


a 


lot. 


I 


like 


it 


a 


little. 


I 


don 


't 


like 


it . 


Social 
Studies : 


I 


like 


it 


a 


lot . 


I 


like 


it 


a 


little. 


I 


don 


't 


like 


it . 


Reading : 


1 


like 


it 


a 


lot . 


I 


like 


it 


a 


little. 


I 


don 


•t 


like 


it. 


Writing 
(Language 
Arts) 


1 


like 


it 


a 


lot. 


I 


like 


it 


a 


little. 


I 


don 


•t 


like 


it . 


Science : 


I 


like 


it 


a 


lot . 


I 


like 


it 


a 


little. 


I 


don 


't 


like 


it . 
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4 Circl* th« wordtf th*t Bhow HO^ GOOD YOU ARK in •aah o£ thaaa tub j^cta . 



Reading: 


I mm really 
good at this . 


I do all right 
at this. 


Z am not very 
good at this. 


Science: 


I asa really 
good at this * 


Z do all 
at this. 


right 


Z am not very 
good at this. 


Writing/ 

(Language 

Arts) 


I am really 
good at this . 


1 do all 
at this. 


ri^ht 


1 am not very 
good at this . 


Social 
Studies 


I mm really 
good at this . 


Z do all 
at this. 


right 


Z am not very 
good at this . 


Math: 


Z am really 
good at this . 


Z do all 
at this . 


right 


Z am not very 
good at this . 



